Relative information entropy of an inhomogeneous universe 
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Abstract. In the context of averaging an inhomogeneous cosmological model, we propose a natural measure identical to 
the Kullback-Leibler relative information entropy, which expresses the distinguishability of the local inhomogeneous density 
field from its spatial average on arbitrary compact domains. This measure is expected to be an increasing function in time 
and thus to play a significant role in studying gravitational entropy. To verify this conjecture, we explore the time evolution 
of the measure using the linear perturbation theory of a spatially flat FLRW model and a spherically symmetric nonlinear 
solution. We discuss the generality and conditions for the time-increasing nature of the measure, and also the connection to 
the backreaction effect caused by inhomogeneities. 
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1. INTRODUCTION 

Modern cosmology is based on the hypothesis called the Cosmological Principle, and the universe is assumed to 
be successfully described by a homogeneous and isotropic Friedmann-Lemattre-Robertson- Walker (FLRW) universe 
model on large scales. In spite of its simplicity, this hypothesis is highly non-trivial because a realistic universe model 
should include local inhomogeneities, and the physical property of such a realistic model averaged over a sufficiently 
large scale does not necessarily coincide with that of the FLRW universe. The difference between a spatially averaged 
inhomogeneous universe and the FLRW universe has been emphasized by Ellis [1] and studied since the pioneering 
works by Futamase [2, 3]. This topic is now widely noticed in the context of dark energy cosmology; the effect of 
inhomogeneities may be an alternative to introducing an exotic matter for the cosmic acceleration. (See, e.g. Ref. [4]; 
Refs. [5, 6] for comprehensive reviews.) 

In quantifying how a realistic inhomogeneous universe model departs from the FLRW one, it would be convenient 
to utilize some measure of inhomogeneity. In Information Theory, if we have two probability distributions, {pf} and 
{qi}, and would like to quantify the distinguishability of the two distributions, the relevant quantity is known to be the 
relative information entropy (sometimes called the Kullback-Leibler divergence) [7]: 

^kl{H 1"-, (1) 

T 91 

where {p, •} and {qf} are the actual and presumed probability distributions, respectively. This relative entropy is positive 
for qi p^ and zero if the two distributions {/?,} and {qi} agree. Note that the .^^{p II <?} is n °t symmetric for {/?,} 
and {qi}. With the help of the concept of the Kullback-Leibler relative information entropy, we proposed in our 
previous work [8] a natural measure of inhomogeneity in the universe, in the form 

y{p\\ (P)f}:= / plny^-d/i, (2) 

where p and (p) $ are respectively the actual matter distribution and its spatial average, dfi is the Riemannian volume 
element, and the integration is performed on a compact spatial domain '3. Here we have adopted the formulation of 
averaging inhomogeneous universes developed by one of the authors [9]. We also conjectured that the measure (2) is 



an increasing function of time for sufficiently large times. Intuitively this measure is likely to have the time-increasing 
nature, but detailed analyses are required to show it. It is actually significant whether this conjecture is correct because 
the positive conclusion for the conjecture will lead to the validity of our measure being regarded as entropy in a 
gravitational system. The possibility that our measure is concerned with gravitational entropy has been discussed in 
Ref. [10]. 

In this paper, we explore the time evolution of the measure using specific models of an inhomogeneous universe, 
and examine on what condition the time-increasing nature of the measure holds. We employ the linear perturbation 
theory of a spatially flat FLRW universe and a spherically symmetric nonlinear solution as inhomogeneous universe 
models, and illustrate the temporal behavior of the measure explicitly with the models. 

This paper is organized as follows. In the next section, we give a brief review of the formalism of averaging 
inhomogeneous universes by following Ref. [9]. In the section 3, we introduce a measure of inhomogeneity analogous 
to the Kullback-Leibler divergence, and derive the time derivatives of the measure with a general consideration for the 
time-increasing nature of the measure. We present illustrative examples of the time evolution of the measure using the 
linear perturbation theory and a spherically symmetric exact solution, in the sections 4 and 5, respectively. Finally in 
the section 6, we summarize our results and give an outlook. 



2. BASICS OF AVERAGING INHOMOGENEOUS UNIVERSES 

Let us start by recalling the basic equations that govern the dynamics of a spatially averaged inhomogeneous universe, 
along the formulation developed by one of the authors [9, 11]. We shall restrict our consideration, for simplicity, to 
an irrotational pressureless fluid with energy density p and four- velocity uP- , and work in a time-orthogonal foliation 
with the line element 

ds 2 = -6t 2 +g ij 6X i 6X j , (3) 

where X 1 are coordinates in the t — const, hypersurfaces (with three-metric gij) that are comoving with the fluid 
so that the four- velocity vP = (1,0). It is convenient for a description of the dynamics to use the expansion tensor 
&ij := (l/2)g'y, where an overdot (') denotes time derivative, and its trace := g lj &ij (the local expansion rate), 
and the traceless part (7y := © J; — (l/3)9gij (the shear tensor). Using these quantities as dynamical variables, the 
continuity equation and the Raychaudhuri equation are written as 

p+p0=O, (4) 

6 = -47tGp-ie 2 -2c7 2 , (5) 

where a 2 :— (1 /2)o'jO J i is the rate of shear squared. 

We define averaging of a scalar quantity A (t,X l ) by the Riemannian volume average over a compact spatial domain 

@: 

<Mt,X')) 9 := -i- / A(t,X')V8d 3 X ■ V 9 {t) := / ^d 3 X, (6) 

with the Riemannian volume element djj, := ^fg d 3 X, g := det(gy), of the spatial hypersurfaces of constant time. 
We also introduce an effective scale factor via the volume (normalized by the volume of the initial domain Vg..), 
a@(t) := (V@(t) /V&yl 3 . Then the averaged expansion rate is expressed in terms of the effective scale factor as 

(0)^ = ^ = 3—. (7) 

The key concept in the averaging formalism is non-commutativity of two operations, spatial average and time evolution. 
This is expressed by a commutation rule for the averaging of a scalar field A [9, 11, 12, 13]: 

j t (A)oj - = (Ae)s, - (£) 9 {6) 9 = (8AS9)® , (8) 

where 8 A := A — (A}@ and 80 := — (0)@ represent the deviations of local values of the fields from their averages. 
Averaging Eqs. (4) and (5) with the help of Eq. (8) yields 

^(P)® + (PM0>^=O, (9) 



3— + 4nG(p)® = Q 9 ; Q,j:^h(e 2 )r J -(e)%)-2(a 2 ),j, (10) 

where Qg is the 'kinematical backreaction term', which appears due to inhomogeneities of cosmic matter distribution 
and leads the effective cosmic expansion given by to deviate from the Friedmannian one. Equation (10) tells us 
that the kinematical backreaction term consists of the fluctuation of the expansion rate and the averaged shear rate; the 
former plays the role of effective negative pressure, and the latter can be regarded as additional matter density. 



3. RELATIVE INFORMATION ENTROPY 

In order to introduce a quantity that measures how the universe is inhomogeneous within the formulation explained in 
the previous section, we pay particular attention to the commutation rule for the matter density field: 

§- t (p)®~ {^) = (pV® - <pM >® = ( § p 8d )® ■ ( n ) 

This means that the time evolution of the averaged density field does not coincide with the average of the density field 
evolved locally. We consider that the difference between (p ) ^ and (p ) $ leads to the entropy production for the matter 
density field. This idea brings us to write 

where is an entropy associated with the density field. Looking for a functional of the matter density field that 
satisfies Eq. (12), we find that, interestingly, the answer is [8]: 

^{Pll (PM:= / pln-^-v^d 3 X, (13) 

which is analogous to the Kullback-Leibler relative information entropy, Eq. (1). Note that, for strictly positive density, 
p > 0, the entropy .y{p \\ (p)s>} is positive definite if p ^ (p)g,, and = if and only if p = (p)®. 

Let us explore the temporal behavior of the relative information entropy S^{p || (p)®} to verify whether the 5? 
possesses the time-increasing nature. From Eqs. (11) and (12), the time derivative of the entropy is immediately found 
to give 

^-y{p || (pM = - / 8p89^& i X = -V 9 (8p89)®. (14) 
at JQ> 

We expect from Eq. (14) that the time derivative of 5? will generally be positive in view of cosmological structure 
formation, because, on average, an overdense region (8p > 0) tends to contract (89 < 0) to form a cluster, and 
an underdense region (Sp < 0) tends to expand (89 > 0) to form a void. To be more precise, however, how 
inhomogeneities evolve depends on initial conditions, particularly at an early stage of the evolution. For example, 
a fluid element included in an overdense region does not necessarily have an initial expansion rate with the direction of 
contracting, because the density field and the local expansion rate are given independently in the initial data setting. At 
a sufficiently late stage, the effect of initial conditions will get weaker and inhomogeneities will evolve according to the 
intuitive manner as we mentioned above, leading to the positivity of the time derivative of the entropy. It is therefore 
plausible that, even if the time derivative of the entropy is negative temporarily, it will become positive eventually. 
This idea implies the importance of examining whether the second time derivative of the entropy is positive, i.e. the 
time-convexity of the entropy. Differentiation of Eq. (14), together with Eqs. (5) and (8), yields 

1 d 2 . . , , , 1 



^i y {P II (PM = A%G ( A P) Z + (P>» ( A0 ) 2 + 3 ( § P 89 l ) 9 + 2{8p 8a l )r S , (15) 



where Ap := \J ((8p) 2 )% and A9 := \J ((8d) 2 )@ are the fluctuation amplitudes of density and expansion, respectively. 
Using the formula 

8(9 2 ) =2(9) S) S9 + (S9) 2 -(A9) 2 , (16) 



the second time derivative of the entropy, Eq. (15), is rewritten as 



4nG(Ap) 2 + l -(p(8df)v + ^{p) 9 (A9) 2 + 2(8p 8a 2 ) 9 + \{9)s{8p 89)® (17) 

4nG(Ap) 2 + 1 -(p(89) 2 ) & + 2(pa 2 )® + (p)®Q® -\(6) 9 %- ■ (18) 

In order to clarify the conditions under which the positivity of y holds, the sign of the second time derivative 3* is 
crucial, in particular at the instant t = t c when 3* = 0. If 3*(t = t c ) is shown to be positive, we can conclude that 3* is 
always positive thereafter. Note that, from Eq. (18), this applies to the case when the backreaction term is positive 
at t = t c . One typical behavior of 3* will be the following: suppose that 3* is negative at some time for an averaging 
domain 21 large enough for the averaged expansion rate {9)s> > and the averaged shear rate (a 2 ) ^«0. Then from 
Eq. (18), 3* is positive and thus 3* increases with time. If 3* is not bounded by a negative value, 5? reaches zero at 
t = t c and stays positive thereafter. 




4. EVOLUTION OF THE ENTROPY IN THE LINEAR REGIME 

In what follows, we illustrate the temporal behavior of the entropy S fi by using specific models. First let us observe 
the positivity of 3" using the linear perturbation theory, which is valid in the early stage of structure formation in 
the universe, where the deviation from a homogenous and isotropic background is small. This illustrative calculation 
with the linear perturbation theory is, in a sense, most intuitive and easiest to carry out. The average properties of an 
inhomogeneous universe constructed with the linear perturbation theory have been investigated in Ref. [ 14] . We follow 
Ref. [14] in the method of the calculation performed in this section. 

Suppose that the three-metric is written as gjj = a(f) 2 (y !; - + hij) with the Friedmannian scale factor a(t), the 
background metric Yij, and metric perturbation hij, and a scalar quantity A (t,X l ) is divided into a homogeneous part 
Ah(0 and an inhomogeneous perturbation A p (t,X'), which is associated with hij. The spatial average (A)@ is then 
represented in terms of perturbation variables as 

<A) 9 ■=■$-! A^gd 3 X=A H + {A p ) 7 + 1 -((A p h) r -(A p ) 7 (h) Y ) + 0(h 3 ) 1 (19) 

where (-)y := f@(-)y/Y d 3 X/ f@ y/y cftx (y := det(y 7 )) denotes the average defined on the background three-space, 
and h := Y^hj. Introducing another scalar quantity B(t,X l ) = Bjj(t) + B p (t ,X l ) with a homogeneous part Bu(t) and a 
perturbation B p (t,X l ), we have the following useful formula: 

(8A8B) 9 = {A p B p )y-{A p ) y {B p ) y +ff{h i ). (20) 

The scalar-mode solution for the linear metric perturbation hjj in a spatially flat background without a cosmological 
constant is [14, 15] 

20 

hij - y¥)jy + 2D + (0*F|y + 2D_(0*|y , (21) 

where VP = ^(X 1 ) and <t> = <J>(X') are arbitrary functions of only spatial coordinates X', determined by initial 
conditions, | denotes covariant derivative with respect to Yij, an d D + (t) = t 2 ^ 3 and D-(t) = t~ l are time-dependent 
factors of the growing and decaying modes, respectively. The energy density and the expansion rate are then given as 

p = pH^-f^V^-f-'vW) , (22) 

9 = 3- + -r 1/3 V 2l P-f- 2 V 2 4>, (23) 
a 3 

where pn = pn{t ) is the energy density of the homogeneous background, and V 2 (-) := Y'(')\ij- 

Inserting Eqs. (22) and (23) into Eq. (20), the time derivative of the entropy is calculated straightforwardly as, to the 
leading order, 

2 f -io/3 ^ V 2 W v 2 4>) y -(V 2 *P) r (V 2 4>) r ] 
9 

(24) 



4nG^- = V 5 /3[ (( v 2 ^) 2 ) y -(V 2 vp) 2 ]- 
-V 5 [((V 2 4>) 2 ) y -(V 2 4>) 2 ]. 



Equation (24) tells us that, if the dynamics of inhomogeneity is dominated by the growing mode, 5? is positive, mean- 
ing that the universe becomes more and more inhomogeneous. At early times, the decaying mode may dominate the 
growing one, and then 5? < 0, which implies that the universe can temporarily become less and less inhomogeneous, 
but for large enough times, the growing mode is expected to dominate and > eventually. One exception is the 
case where there is no growing mode, but it is quite rare and unphysical, and we can ignore it safely. Thus on the 
positivity of in the linear regime, we can claim that the time derivative becomes positive at least for sufficiently 
large times, unless the growing mode is exactly zero. 

In order to show the above fact from another point of view, let us consider the second time derivative y, Eq. (15). 
Estimating each term of the right-hand side of Eq. (15) with the linear perturbation theory, we find that the leading 
order of the last term is &(h i ) while that of the other terms is 0(h 2 ). Hence the last term can be neglected in this 
consideration. In addition, we can utilize the following approximate formula in the linear regime: 

(8p8e 2 ) 9 ^2(e)®(8p89}®, (25) 

and thus we obtain 

« AnG (Ap) 2 + (p) 9 (A9) 2 + \(e)®{8p 8Q) 9 . (26) 
V® 3 

We find from Eq. (26) that, when 5? < 0, the second derivative ,9" is positive because all terms in the right-hand side 
of Eq. (26) are positive; if — at an instant t = t c , the second derivative J? at t = t c is positive. Therefore, is 
always going to be positive at t — t c , and thereafter stays positive, as far as the dynamics is in the linear regime. 

These facts are also understood directly by an explicit form of the second time derivative, written in terms of the 
linear perturbations. It is actually given as, to the leading order, 

47rG C = ^ r8/3 [(( v2 ^) 2 )r-( v2 ^)r]+^ rl3/ M( v2 * v2 *>r-( v2x P>r( v2 *>r] 

+2f- 6 [((V 2 4>) 2 ) r -(V 2 4>) 2 ,] (27) 



- A r 8/3 
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(v 2i p + 1 - 5 /3 V 2 4>) 2 ^ - (v 2 ^ + r 5/3 v 2 4> 
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; "[((V 2 4>) 2 ) y -(V 2 4>) 2 ] >0. (28) 



Hence we obtain the following proposition in the linear regime: The second time derivative S" is positive definite in 
the linear regime. Therefore, even if y is negative for a while, y is always going to be positive. Once y arrives at 
zero, y is always positive thereafter during the linear regime. 



5. NONLINEAR EXAMPLE WITH THE LTB MODEL 

We proceed in this section to explore the time evolution of the relative information entropy y{p || (p)^} in the 
nonlinear regime with the spherically symmetric Lemaitre-Tolman-Bondi (LTB) solution. This exact solution of 
Einstein's equations is often employed as a model of an inhomogeneous universe [16, 17, 18, 19]. The line element of 
the LTB solution reads 

ds 2 = -At 2 + Y^J dRl + r2 ( d ^ + si " 2 ^ 2 ) ' (29) 

where a prime ( ') denotes d / dR, f = f(R) is an arbitrary function of the comoving radial coordinate R with / > — 1, 
and r = r(t,R). Then Einstein's equations yield 

STtGp = , (30) 

r 2 = ^+f(R), (31) 

where F(R) is another arbitrary function, which represents the initial mass distribution. The solutions of Eq. (31) can 
be expressed in the following form: 



(i) />0: 

r= Z.( coshT j-l), t -T(R) = ^( S mhri-ri) 7 (32) 

(ii) /<0: 

r= 3^(1 -cost?), t-T(R) = ^-^(tj - sinrj) , (33) 

(iii) / = 0: 

'gr\ 1/3 

" (r-r(/?)) 2 / 3 , (34) 

where is a third arbitrary function that comes from integrating Eq. (31). In any of these three cases, the expansion 
rate and the shear rate squared are given as 

r r r z r 3 \r ry 

If we regard the LTB solution as a spatially flat FLRW universe plus spherical linear perturbations, and make a 
connection between the functions f(R), F(R), and T(R) in the LTB solution, and the functions *P and 4> that appear 
in Eq. (21) in the linear perturbation theory, we obtain [20]: 

f=™VR, F = ^(l + ^y T = - 3 -^'R-K (36) 

These relations tell us that the functions f(R) and T(R) correspond to the growing and decaying modes in the linear 
perturbation theory, respectively. 

Let us write averaged dynamical variables in the LTB solution. Taking a spherical compact domain 

9 = {(R, 0)| < R < R d , < < K, < < 2n} , 

with the comoving radius of the spherical domain Ra, we have 



/ F' \ 4n r R i F' 



dR, (37) 



If r\ An f R A (r 2 f\ 
0^ = (-+2-> =— / \ ' dR, (38) 
\f r/ s V®Jo {l+f) 1 ' 2 

with the volume of the domain 2, 

r«d r 2 f 

v> = **J J^JW AR - (39) 

Using Eqs. (30), (35), (37), and (38), the backreaction term Q@ and the time derivative of the entropy in the spherical 
case become 



, 2 



Q ^\ 2 -A 2 f + r)) 9 -{f +2 r)^ ™ 

87r °^- 7o (i+/)V2 47r 7o rV(i+/)V2- (4i) 

In order to illustrate the time evolution of the entropy, we choose the three arbitrary functions, as is suggested in 
Ref. [21], as 

T(R)=0 for all J? >0, /(*) = ( ~ O) io ^<R<R Q , (42) 

{ for R > R Q , 



70 




60 - 











100 



200 



300 



400 



tit: 



FIGURE 1. The effective scale factors for the spherical domains are plotted as functions of time. The solid line is for the large 
domain, and the dashed one for the small domain. 



where Rq and R\ are constants that satisfy R\ > Ro/2. The inner region (0 < R < R±) of this model is the collapsing 
LTB solution, which is surrounded by a vacuum region (R\ < R < Ro), and the outermost region (R > Rq) is the 
Einstein-de Sitter universe, i.e. a spatially flat FLRW universe without a cosmological constant. Setting T(R) — is 
appropriate for our purpose, because the function T(R) corresponds to the decaying mode in the linear perturbation 
theory, and its effect disappears for sufficiently large times. 

In our illustration, we choose the constants Rq and R\ so that R\ = 3Rq/4, and consider two cases of the radius R^ 
of the averaging domain: (i) R^ = Rq, which is called 'the large domain', and (ii) R^ = /?o/8, 'the small domain'. Note 
that, in the case of the large domain, the averaging domain contains the collapsing LTB region and the vacuum region, 
while the small domain consists of only the collapsing LTB region. As the result of the choice of the domain, the 
evolution of the effective scale factor for the large (small) domain is similar to that of a spatially flat (closed) FLRW 
universe, as we see in Fig 1 . 

We also present the time evolution of the kinematical backreaction term divided by its initial value for the large and 
small domains in Fig. 2. In both cases, the backreaction term has, in fact, negative values through the evolution, and 
thus we find that the results shown in Fig. 2 are consistent with those given in Fig 1. 

Next we show the time evolution of the time derivative of the entropy, 5^(t~), in Figs. 3 (for the large domain) 
and 4 (for the small domain). It should be emphasized that is positive in both cases throughout the evolution in 
our investigation. In the case of the large domain, however, the 5? decreases with time temporarily, meaning that 
the second time derivative ^ is negative at early times. We presume that this result is caused by the vacuum region 
contained in the large domain, because the vacuum is a completely nonlinear structure where the linear perturbation 
theory does not apply, while the behavior of nonlinear clumps is somewhat similar to that of the linear perturbation at 
the early stage of the evolution. Detailed investigation is needed on this point. 



In this paper, we study the time evolution of the Kullback-Leibler relative information entropy for cosmic matter 
distribution which was proposed as a measure of cosmic inhomogeneity in our previous work [8]. Intuitively this 
entropy is likely to possess the time-increasing nature, but it generally depends on initial conditions. We employ the 
linear perturbation of a spatially flat FLRW universe and the LTB model to demonstrate that the relative information 
entropy is convex and increases in time. 




for <R<R\ , 
for Ri<R<R , 

for R > R Q , 



(43) 



6. SUMMARY AND OUTLOOK 
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FIGURE 2. The time evolution of the backreaction term divided by its initial value is plotted. The solid line is for the large 
domain, and the dashed one for the small domain. 
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FIGURE 3. The time derivative of the entropy for the large domain is plotted as a function of time. 



We obtain explicit forms of the time derivative and the second time derivative of the entropy through the linear 
perturbation calculation. They tell us that in the linear regime of cosmic structure formation, the entropy is shown to 
be an increasing function of time at least for sufficiently late times, even if the entropy decreases temporarily at early 
times. We also give an illustrative example of the time evolution of the entropy with a nonlinear LTB solution. This 
illustration also supports the time-increasing nature of the entropy although it shows that the entropy is not always 
time-convex. It seems from the example whether or not the measure is time-convex depends on the fraction of devoid 
regions within the averaging domain, i.e. on whether the universe is void-dominated. This will be further investigated 
in detail in a forthcoming publication. 
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FIGURE 4. The same as Fig. 3, but for the small domain. 
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